An Efficient Learning Procedure for Deep Boltzmann Machines
نویسندگان
چکیده
منابع مشابه
Efficient Learning of Deep Boltzmann Machines
We present a new approximate inference algorithm for Deep Boltzmann Machines (DBM’s), a generative model with many layers of hidden variables. The algorithm learns a separate “recognition” model that is used to quickly initialize, in a single bottom-up pass, the values of the latent variables in all hidden layers. We show that using such a recognition model, followed by a combined top-down and ...
متن کاملDeep Learning using Restricted Boltzmann Machines
Restricted Boltzmann machines (RBM) are probabilistic graphical models which are represented as stochastic neural networks. Increase in computational capacity and development of faster learning algorithms, led RBMs to become more useful for many machine learning problems. RBMs are the building blocks of many deep multilayer architectures like Deep Belief networks (DBN) and Deep Boltzmann Machin...
متن کاملLearning Deep Boltzmann Machines using Adaptive MCMC
When modeling high-dimensional richly structured data, it is often the case that the distribution defined by the Deep Boltzmann Machine (DBM) has a rough energy landscape with many local minima separated by high energy barriers. The commonly used Gibbs sampler tends to get trapped in one local mode, which often results in unstable learning dynamics and leads to poor parameter estimates. In this...
متن کاملMultimodal Learning with Deep Boltzmann Machines
A Deep Boltzmann Machine is described for learning a generative model of data that consists of multiple and diverse input modalities. The model can be used to extract a unified representation that fuses modalities together. We find that this representation is useful for classification and information retrieval tasks. The model works by learning a probability density over the space of multimodal...
متن کاملEfficient Learning in Sparsely Connected Boltzmann Machines
We present a heuristical procedure for eecient estimation of the partition function in the Boltzmann distribution. The resulting speed-up is of immediate relevance for the speed-up of Boltzmann Machine learning rules, especially for networks with a sparse connectivity.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Computation
سال: 2012
ISSN: 0899-7667,1530-888X
DOI: 10.1162/neco_a_00311